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A  large  spectator  event  like  the  Super  Bowl  pre¬ 
sents  a  prime  target  for  terrorists.  Fearing  the 
potential  for  such  an  attack  or  other  serious  criminal 
incident,  law  enforcement  officials  in  Tampa,  Florida 
turned  for  help  to  a  new  technology:  biometrics,  the 
use  of  a  person’s  physical  characteristics  or  personal 
traits  for  human  recognition.  Digitized  fingerprints, 
voiceprints,  iris  and  retinal  scans,  hand  geometry,  and 
keystroke  dynamics  are  all  examples  of  this  technol¬ 
ogy.  The  biometric  system  used  at  Super  Bowl  XXXV 
relied  on  facial  recognition.  Specifically,  surveillance 
cameras  surreptitiously  scanned  spectators’  faces  to 
capture  images.  Algorithms  then  measured  facial  fea¬ 
tures  from  these  images — such  as  the  distances  and 
angles  between  geometric  points  on  the  face  like  the 
mouth  extremities,  nostrils,  and  eye  corners — to  pro¬ 
duce  a  “faceprint.”  This  faceprint  was  then  instantly 
searched  against  a  computerized  database  of  suspect¬ 
ed  terrorists  and  known  criminals  to  recognize  a  spe¬ 
cific  individual.  A  match  would  have  alerted  police  to 
the  presence  of  a  potential  threat.1 

Should  we  be  concerned  about  the  government’s 
use  of  this  technology?  One  could  argue  that  “facial 
recognition”  is  a  standard  identification  technique  and 
that  it  raises  no  special  concerns.  After  all,  we  look  at 
each  other’s  faces  to  recognize  one  another.  Police 
regularly  use  mugshots  to  identify  criminals.  And  we 
think  nothing  of  being  asked  to  display  “photo  ID” 
to  confirm  our  identity.  On  the  other  hand,  the  use  of 
a  biometric  facial  recognition  system  such  as  that 
employed  at  the  Super  Bowl  is  different  in  certain 
respects  from  these  more  familiar  uses,  and  it  has  the 


potential  to  present  greater  risks  as  well  as  greater 
advantages. 

This  issue  paper  describes  the  concerns  raised  by 
the  use  of  biometric  facial  recognition,  and  it  discuss¬ 
es  how  the  technology  could  potentially  threaten  our 
right  to  privacy.  The  paper  also  discusses  the  technol¬ 
ogy’s  countervailing  benefits  to  national  security  and 
law  enforcement,  and  it  concludes  by  offering  policy 
recommendations  to  help  maximize  the  technology’s 
utility  while  minimizing  its  threat  to  our  privacy. 

Privacy  Concerns  of  Current  Uses 

Biometric  technologies  may  seem  exotic,  but  their  use 
is  becoming  increasingly  common,  and  in  2001  MIT 
Technology  Review  named  biometrics  as  one  of  the 
“top  ten  emerging  technologies  that  will  change  the 
world.”  Biometric  facial  recognition,  although  it  is 
far  from  foolproof  and  not  yet  technically  perfected, 
is  being  used  in  a  wide  array  of  applications.  For 
example,  it  is  being  used  to  control  access  to  com¬ 
puters  and  facilities,  replacing  badges  and  passwords. 
The  gaming  industry  relies  on  facial  recognition  as 
part  of  casino  security  to  identify  “card  counters” 
and  other  undesirables.  Check-cashing  operations,  tra¬ 
ditionally  plagued  with  high  rates  of  fraud,  are  using 
facial  recognition.  Since  1998,  the  West  Virginia  Depart¬ 
ment  of  Motor  Vehicles  has  been  using  the  technolo¬ 
gy  to  check  for  duplicate  and  false  driver’s  license  reg¬ 
istrations.  The  British  use  it  to  fight  crime  in  places 
like  Newham,  England  and  to  combat  hooliganism 
at  soccer  games.  The  Israeli  government  uses  facial 
recognition  to  automate  the  border-crossing  process 
for  workers  entering  Israel  from  Palestine.  And  in 
1999,  the  Mexican  government  deployed  a  facial 
recognition  system  to  eliminate  duplicate  voter  regis- 


tration  in  the  presidential  election.  As  the  technology 
improves  and  becomes  more  cost-effective,  its  uses 
will  expand. 

Although  the  concept  of  recognizing  someone 
from  facial  features  is  intuitive,  facial  recognition,  as 
a  biometric,  makes  human  recognition  a  more  auto¬ 
mated,  computerized  process.  It  is  this  aspect  of  the 
use  of  biometrics  that  raises  the  fear  that  we  are  los¬ 
ing  our  ability  to  control  information  about  our¬ 
selves — that  we  are  losing  our  right  to  privacy. 

Does  the  use  of  this  technology  violate  legally  pro¬ 
tected  privacy  rights?  Legal  rights  to  privacy  may  be 
found  in  three  sources:  federal  and  state  constitutions 
(if  the  entity  invading  your  rights  is  a  government 
actor),  the  common  law  of  torts  (if  the  entity  invad¬ 
ing  your  rights  is  a  private  actor),  and  statutory  law. 

Although  the  word  “privacy”  does  not  appear  in 
the  U.S.  Constitution,  the  concern  with  protecting 
citizens  against  government  intrusions  into  their  pri¬ 
vate  sphere  is  reflected  in  many  of  its  provisions.  For 
example,  the  First  Amendment  protects  freedom  of 

expression  and  association  as  _ _ 

well  as  the  free  exercise  of  reli-  p)oes  the  use  0f  this 
gion,  the  Third  Amendment  technology  violate  legally 

prohibits  the  quartering  of  sol-  .  .  , 

j.  ,  ,  ,  ^  ,  protected  privacy  rights? 

diers  in  one  s  home,  the  Fourth  r  r 

Amendment  protects  against 

unreasonable  searches  and  seizures,  the  Fifth  Amend¬ 
ment  protects  against  self-incrimination,  and  the  Due 
Process  Clause  of  the  Fourteenth  Amendment  pro¬ 
tects  certain  fundamental  “personal  decisions  relating 
to  marriage,  procreation,  contraception,  family  rela¬ 
tionship,  child  rearing,  and  education.”2  The  consti¬ 
tutional  “right  to  privacy”  therefore  reflects  concerns 
not  only  for  one’s  physical  privacy — the  idea  that 
government  agents  cannot  barge  into  one’s  home — 


but  also  for  less  tangible  interests — the  idea  that  citi¬ 
zens  should  be  able  to  control  certain  information 
about  themselves  and  to  make  certain  decisions  free 
of  government  compulsion.  And  the  Supreme  Court 
has  cautioned  that  it  is  “not  unaware  of  the  threat  to 
privacy  implicit  in  the  accumulation  of  vast  amounts 
of  personal  information  in  computerized  data  banks 
or  other  massive  government  files.”3 

The  use  of  biometric  facial  recognition  potentially 
implicates  both  types  of  privacy  interests.  Neverthe¬ 
less,  law  enforcement’s  use  of  the  technique  at  the 
Super  Bowl  does  not  appear  to  run  afoul  of  the  pro¬ 
tections  afforded  by  the  U.S.  Constitution.4  Some 
civil  libertarians  argue  that  the  sort  of  mass,  dragnet 
scanning  that  took  place  at  the  Super  Bowl  is  improp¬ 
er,  and  that  law  enforcement  must  have  individual¬ 
ized,  reasonable  suspicion  that  criminal  activity  is 
afoot  before  it  can  “search”  a  subject’s  face  to  see  if 
it  matches  that  of  a  wanted  individual  in  its  database. 
Under  current  law,  however,  the  type  of  facial  recog¬ 
nition  used  at  the  Super  Bowl 
would  almost  certainly  be  consti¬ 
tutional.  The  Supreme  Court  has 
explained  that  government  action 
constitutes  a  search  when  it  invades 
a  person’s  reasonable  expectation 
of  privacy.  But  the  Court  has  also 
found  that  a  person  does  not  have  a  reasonable 
expectation  of  privacy  with  regard  to  physical  char¬ 
acteristics  that  are  constantly  exposed  to  the  public, 
such  as  one’s  facial  features,  voice,  and  handwriting.5 
So  although  the  Fourth  Amendment  requires  that  a 
search  conducted  by  government  actors  be  “reason¬ 
able,”  which  generally  means  that  there  must  be  some 
degree  of  suspicion  that  the  person  to  be  searched  is 
engaged  in  wrongdoing,  the  scan  of  spectators’  facial 


Some  civil  libertarians  argue 
that  the  sort  of  mass,  dragnet 
scanning  that  took  place  at 
the  Super  Bowl  is  improper. 


characteristics  at  the  Super  Bowl  did  not  constitute  a 
search.  And  with  respect  to  concerns  about  informa¬ 
tion  privacy,  if  law  enforcement  officials  limited  their 
actions  to  simply  comparing  scanned  images  of  people 
entering  the  stadium  with  their  computer  database  of 
suspected  terrorists  and  known  criminals,  then  infor¬ 
mation  privacy  concerns  would  probably  not  arise  so 
long  as  no  information  about  individuals  were 
retained,  disclosed,  or  linked  to  any  other  database. 

Potential  Privacy  Concerns  as  the 
Technology  Advances 

As  the  technology  advances,  however,  particularly  to 
the  point  that  many  facial  recognition  or  other  bio¬ 
metric  databases  become  interlinked,  then  the  threat 
to  information  privacy  has  the  potential  to  increase 
significantly.  With  biometric  facial  recognition,  the 
loss  of  information  privacy  essentially  takes  two 
forms:  fears  of  tracking  and  clandestine  capture. 
Tracking  refers  to  the  ability  to  monitor  an  individ¬ 
ual’s  actions  in  real  time  or  over  a  period  of  time.  In 
its  most  extreme  incarnation,  tracking  could  become 
a  kind  of  “super  surveillance”  that  lets  the  tracker 
“follow”  a  person  today  as  well  as  search  databases 
to  learn  where  he  was  months  ago. 

For  example,  suppose  the  authorities  place  me  in 
their  “watch  list”  database.  As  I  go  about  my  many 
daily  tasks,  surveillance  cameras  could  capture  my 
faceprint  and  digitally  transmit  this  biometric  infor¬ 
mation  for  instantaneous  searching  against  the  watch 
list.  As  I  board  the  subway  on  my  way  to  work,  enter 
and  exit  my  office  building,  stop  by  the  ATM,  make 
purchases  in  stores,  visit  my  doctor,  or  attend  a  polit¬ 
ical  rally,  my  faceprint  will  be  matched  with  informa¬ 
tion  in  the  database,  allowing  the  surveiller  to  track 


my  movements.  Similarly,  the  authorities  can  enter  on 
their  watch  list  the  biometric  information — the 
faceprints — of  all  those  who  attended  the  political 
rally  with  me.  The  authorities  could  then  “reverse 
engineer”  the  identity  of  these  individuals,  by  search¬ 
ing  the  database  for  their  previous  movements.  If 
such  a  system  were  established,  it  would  become  pos¬ 
sible  to  compile  a  comprehensive  profile  of  an  indi¬ 
vidual’s  movements  and  activities. 

The  theoretical  possibility  that  the  government 
could  compile  such  massive  databases,  and  that  such 
databases  could  be  used  by  law  enforcement,  raises 
the  specter  of  “Big  Brother”  tracking  its  citizens’  every 
move.  The  clandestine  capture  of  biometric  data  in¬ 
creases  these  fears.  As  the  above  example  makes 
clear,  facial  recognition  systems  can  surreptitiously 
track  individuals  without  their  knowledge  or  permis¬ 
sion.  Moreover,  the  information  from  tracking  can  be 
combined  with  other  personal  data,  acquired  by 

_ _ _  other  means  (through,  for  exam- 

Witb  biometric  facial  pie,  a  social  security  number),  to 
recognition ,  the  loss  of  provide  even  more  insight  into  an 

information  privacy  individual’s  private  life 

„  Whether  such  technological 

essentially  takes  two  forms:  adyances  as  the  capability  for 

fears  of  tracking  and  “super  surveillance”  could  render 
clandestine  capture,  certain  applications  of  this  tech- 

-  nology  unconstitutional  remains 

to  be  seen.  If  the  compilation  of  information  in  these 
databases  had  a  significant  chilling  effect  on  First 
Amendment  rights,  such  as  attending  a  political  rally, 
if  it  impinged  on  fundamental  rights  of  decisional  pri¬ 
vacy,  or  if  the  information  were  insufficiently  safe¬ 
guarded  against  unauthorized  disclosure,  then  the 


maintenance  of  such  databases  could  potentially  run 
afoul  of  the  law.6 

Given  these  potential  concerns,  civil  libertarians 
are  correct  that  we  should  be  mindful  of  emerging 
technologies  that  may  invade  our  privacy,  and  it  is 
wise  to  monitor  their  development  to  forestall  poten¬ 
tial  abuses.  We  should,  however,  also  ensure  that  per¬ 
ceived  or  potential  threats  to  our  privacy  do  not  blind 
us  to  the  positive  uses  of  biometric  technologies  like 
facial  recognition. 

Benefits  of  the  Technology 

At  the  Super  Bowl,  law  enforcement  used  facial  recog¬ 
nition  as  part  of  its  efforts  to  prevent  a  terrorist  act 
or  other  serious  criminal  incident.  Although  no  sus¬ 
pected  terrorists  were  apprehended,  the  authorities 
took  prudent  steps  to  identify  them  if  they  had  cho¬ 
sen  to  show  their  faces.  The  national  security  com¬ 
munity  also  understands  the  need  for  such  precau¬ 
tions,  and  it  believes  that  biometric  facial  recognition 
can  help  identify  and  protect  against  terrorist  threats 
to  U.S.  forces  and  our  embassies  abroad. 

Terrorist  attacks  have  extracted  a  painful  toll.  For 
example,  in  Saudi  Arabia  in  1996,  terrorists  explod¬ 
ed  a  truck  bomb  near  Building  131  of  Khobar 
Towers.  Nineteen  service  members  died.  Hundreds 
were  injured.  More  recently,  truck  bomb  attacks 
destroyed  the  U.S.  embassies  in  Kenya  and  Tanzania, 
taking  224  lives  and  wounding  some  4,600  others. 
And  on  October  12,  2000,  a  terrorist  attack  on  the 
U.S.S.  Cole  in  the  Yemeni  port  of  Aden  killed  17 
sailors  and  injured  42  more. 

In  the  wake  of  the  Khobar  Towers  terrorist  attack, 
the  Defense  Advanced  Research  Projects  Agency 


(DARPA)  embarked  on  a  $50  million  initiative 
known  as  “Human  ID  at  a  Distance,”  a  major  com¬ 
ponent  of  which  is  facial  recognition.  DARPA’s  ambi¬ 
tious  goal  is  to  help  develop  biometric  technologies, 
like  facial  recognition,  that  can  be  deployed  to  iden¬ 
tify  a  known  terrorist  before  he  closes  on  his  target. 
In  this  way,  lives  can  perhaps  be  saved. 

The  nation’s  political  leadership  has  also  recog¬ 
nized  the  potential  of  biometric  technologies.  Public 
Law  106-246,  signed  by  President  Clinton  on  July 
13,  2000,  included  a  provision  making  the  Army  “the 
Executive  Agent  to  lead,  consolidate,  and  coordinate 
all  biometrics  information  assurance  programs  of  the 
Department  of  Defense.”  On  this  basis,  Deputy  Secre¬ 
tary  of  Defense  Rudy  de  Leon  issued  a  memorandum 
on  December  27,  2000,  consolidating  oversight  and 
management  of  biometric  technology  under  the 
recently  created  DoD  Biometrics  Management  Office. 

Similarly,  while  facial  recognition  did  not  lead  to 
any  arrests  at  the  Super  Bowl,  there  is  evidence  that 
using  such  a  system  can  help  deter  crime.  In 
Newham,  England,  the  crime  rate  fell  after  police 
installed  300  surveillance  cameras  and  incorporated 
facial  recognition  technology.  While  it  is  possible  that 
the  criminals  only  shifted  their  efforts  to  other 
locales,  crime  in  Newham  at  least  was  deterred. 

Moreover,  the  facial  recognition  system  used  at  the 
Super  Bowl  was  not  physically  invasive  or  intrusive 
for  spectators.  In  fact,  it  was  much  less  invasive  than 
a  metal  detector  at  a  public  building  or  an  inaugura¬ 
tion  parade  checkpoint.  In  this  sense,  facial  recogni¬ 
tion  helped  to  protect  the  privacy  of  individuals,  who 
otherwise  might  have  to  endure  more  individualized 
police  attention.  One  potential  criticism  is  that  the 
known  criminals  placed  in  the  database  may  face 


heightened  police  scrutiny  once  they  are  identified  in 
a  public  setting,  despite  the  fact  that  they  have  “paid 
their  debt  to  society.”  One  response  to  this  concern  is 
that  known  criminals  already  face  heightened  police 
scrutiny.  For  example,  a  prior  criminal  record  has 
long  been  a  standard  screening  tool  when  police  are 
developing  a  list  of  suspects,  and  law  enforcement 
routinely  checks  latent  fingerprints  found  at  a  crime 
scene  against  databases  containing  fingerprints  of 
those  with  prior  criminal  histories.  In  1924,  Congress 
authorized  the  Department  of  Justice  to  collect  fin¬ 
gerprint  and  criminal  record  information  from  the 
states.  The  FBI’s  Criminal  Justice  Information 
Services  Division  currently  has  file  holdings  of  finger¬ 
print  cards  totaling  over  219  million. 

While  there  is  also  the  danger  that  the  biometric 
facial  recognition  system  will 
make  an  incorrect  match,  that 
danger  exists  whether  one  is 
using  facial  recognition  or  tra¬ 
ditional  methods  of  identifica¬ 
tion  such  as  comparing  mug- 
shots.  Moreover,  the  potential 
for  error  is  reduced  when 
matches  made  by  biometric  facial  recognition  must 
subsequently  be  confirmed  by  law  enforcement  pro¬ 
fessionals.  And  as  facial  recognition  technology 
improves,  such  misidentifications  will  most  likely 
become  rarer. 

The  technological  impartiality  of  facial  recognition 
also  offers  significant  benefit  for  society.  While  humans 
are  adept  at  recognizing  facial  features,  we  also  have 
prejudices  and  preconceptions.  The  controversy  sur¬ 
rounding  racial  profiling  is  a  leading  example.  Law 
enforcement  officials  searching  for  an  African 


Facial  recognition  helped 
to  protect  the  privacy  of 
individuals ,  who  otherwise 
might  have  to  endure  more 
individualized  police  attention . 


American  male  sometimes  stop  far  too  many  mem¬ 
bers  of  that  group.  Facial  recognition  systems  do  not 
focus  on  a  person’s  skin  color,  hairstyle,  or  manner  of 
dress,  and  they  do  not  rely  on  racial  stereotypes.  On 
the  contrary,  a  typical  system  uses  objectively  mea¬ 
surable  facial  features,  such  as  the  distances  and 
angles  between  geometric  points 


Our  efforts  should  focus  on  the  face,  to  recognize  a  specific 
on  identifying  potential  individual.  With  b.ometrics, 


dangers  and  addressing 
those  concerns  with 
specific  safeguards. 


human  recognition  can  become 
relatively  “human-free”  and  there¬ 
fore  free  from  many  human  flaws. 

While  realizing  that  facial 
recognition  has  the  potential  to  be 
misused  in  ways  that  could  erode  individual  privacy, 
we  must  also  acknowledge  that  this  biometric  tech¬ 
nology  has  many  positive  uses  as  well.  Super  Bowl 
XXXV  showcased  its  potential  to  help  prevent  ter¬ 
rorist  acts  and  criminal  incidents  at  high-profile 
events.  Facial  recognition  can  also  have  beneficial 
uses  closer  to  home.  As  just  one  example,  many  par¬ 
ents  would  most  likely  feel  safer  knowing  their  chil¬ 
dren’s  elementary  school  had  a  facial  recognition  sys¬ 
tem  to  ensure  that  convicted  child  molesters  were  not 
granted  access  to  school  grounds. 


Policy  Recommendations 

So  while  we  must  remain  alert  to  potential  abuses,  it 
would  be  ill  advised  to  decry  the  technology’s  use 
under  all  circumstances.  Instead,  our  efforts  should 
focus  on  identifying  potential  dangers  and  addressing 
those  concerns  with  specific  safeguards.  As  the  above 
discussion  demonstrates,  one  potential  danger  is  func¬ 
tion  creep;  that  is,  databases  individually  designed  for 
a  specific  purpose,  such  as  screening  for  suspected 


terrorists  at  a  large  sporting  event,  could  easily  be 
interlinked  with  databases  designed  for  other  purpos¬ 
es,  such  as  locating  those  who  are  delinquent  on  child 
support  payments  or  have  overdue  library  books. 
The  interlinking  and  interoperability  of  massive  data¬ 
bases  could  lead  to  several  problems.  The  most  seri¬ 
ous  of  these  potential  problems  is  that  much  more 
private  information  is  collected  and  revealed  to  the 
government  entity  than  is  necessary  to  achieve  the 
purpose  of  the  surveillance.  And  as  a  consequence, 
the  damage  caused  by  inadvertent  disclosure  or  unau¬ 
thorized  access  to  the  database  is  much  greater. 

To  prevent  the  unnecessary  growth  and  interlink¬ 
ing  of  databases,  specific  protocols  should  be  estab¬ 
lished  to  govern  what  information  is  authorized  to 
reside  in  the  database.  At  a  minimum,  the  govern¬ 
ment  entity  maintaining  the  database  should  provide 
an  articulable  reason  why  the  information  is  needed, 
how  long  it  needs  to  be  retained  in  the  database,  and 
under  what  conditions  the  information  may  be  dis¬ 
seminated  or  shared  with  others.  To  ensure  the  accu¬ 
racy  of  the  information  compiled  in  the  database,  a 
clear  set  of  standards  should  set  forth  the  criteria  for 
placing  someone  on  a  watch  list,  and  the  data  should 
be  reviewed  periodically  to  purge  outdated  or  inac¬ 
curate  information. 

To  prevent  unauthorized  disclosures,  strict  con¬ 
trols  to  safeguard  information  should  be  required.  The 
database  should  be  made  secure,  access  to  it  should 
be  restricted,  encryption  and  other  technical  measures 
should  be  used  to  thwart  threats,  records  should  be 
made  of  when,  by  whom,  and  for  what  purpose  the 
database  is  accessed,  and  stiff  criminal  penalties 
should  be  available  for  unauthorized  disclosure. 

In  addition  to  regulatory  controls,  it  might  be  use¬ 
ful  to  explore  less  traditional  methods  to  monitor  this 


technology.  For  example,  as  with  any  new  technolo¬ 
gy,  public  understanding  of  its  operation  and  uses 
may  mitigate  many  of  the  fears  about  Big  Brother.  To 
that  end,  the  government  should  be  encouraged  to 
use  the  technology  openly,  rather  than  clandestinely. 

-  Moreover,  the  government  entity 

As  with  any  new  using  biometric  facial  recognition 

technology,  public  should  provide  as  much  informa- 

understanding  of  its  tion  as  Possible  to  the  public 

,  about  the  technology’s  purposes 

operation  and  uses  may  .  .  ...  .  „  „ 

and  capabilities.  Finally,  some 

mitigate  many  of  the  fears  form  Qf  active  oversight,  either 

about  Big  Brother.  government  only  or  a  cooperative 

-  effort  between  government  offi¬ 
cials  and  private  citizens,  such  as  citizen  oversight 

committees,  would  be  useful  not  only  to  quell  fears 
about  the  technology’s  use  but  also  to  ensure  that  it 
will  not  be  abused. 

Conclusion 

Biometric  facial  recognition  can  provide  significant 
benefits  to  society.  At  the  same  time,  the  rapid 
growth  and  improvement  in  the  technology  could 
threaten  individual  privacy  rights.  The  concern  with 
balancing  the  privacy  of  the  citizen  against  the  gov¬ 
ernment  interest  occurs  with  almost  all  law  enforce¬ 
ment  techniques,  however,  and  we  should  not  let  the 
fear  of  potential  but  inchoate  threats  to  privacy,  such 
as  super  surveillance,  deter  us  from  using  facial 
recognition  where  it  can  produce  positive  benefits. 

Biometric  facial  recognition  is  by  no  means  a  per¬ 
fect  technology,  and  much  technical  work  has  to  be 
done  before  it  becomes  a  truly  viable  tool  to  counter 


terrorism  and  crime.  But  the  technology  is  getting 
better  and  there  is  no  denying  its  tremendous  poten¬ 
tial.  In  the  meantime,  we,  as  a  society,  have  time  to 
decide  how  we  want  to  use  this  new  technology.  By 
implementing  reasonable  safeguards,  we  can  harness 
its  power  to  maximize  its  benefits  while  minimizing 
the  intrusion  on  individual  privacy. 
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